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Abstract — It is known that the capacity of parallel (e.g., multi- 
carrier) Gaussian point-to-point, multiple access and broadcast 
channels can be achieved by separate encoding for each sub- 
channel (carrier) subject to a power allocation across carriers. 
Recent results have shown that parallel interference channels are 
not separable, i.e., joint coding is needed to achieve capacity in 
general. This work studies the separability, from a sum-capacity 
perspective, of single hop Gaussian interference networks with 
independent messages and arbitrary number of transmitters and 
receivers. The main result is that the only network that is always 
(for all values of channel coefficients) separable from a sum- 
capacity perspective is the MAC-Z-BC network, i.e., a network 
where a MAC component and a BC component are linked by 
a Z component. The sum capacity of this network is explicitly 
characterized. 

I. Introduction 

Wireless networks are often associated with channel states 
that are time-varying/frequency-selective. These networks are 
equivalently described as parallel (i.e. multi-carrier) Gaussian 
networks. The separability of a parallel Gaussian network 
implies that the network capacity can be achieved by us- 
ing separate coding/decoding over each carrier (i.e. parallel 
component), so that the capacity can be expressed as a sum 
of the capacities of the individual sub-channels, subject to 
optimum power allocation. For instance, it is well known that 
parallel Gaussian point to point channels are separable, with 
the optimal power allocation across the carriers found using 
the water-filling algorithm. Similarly, the parallel multiple 
access (MAC) and broadcast (BC) networks are known to be 
separable. An important consequence of this separability is that 
it greatly simplifies the problem of its capacity characterization 
of parallel channels because for a separable network it suffices 
to study the network in a fixed channel state. Specifically, 
the capacities of ergodic fading Gaussian point to point, 
multiple access and broadcast networks are the averages of 
the capacities achieved over each channel fading state, subject 
to the optimum power allocation. 

Unlike parallel Gaussian point to point, MAC and BC 
networks, it has been discovered recently, in references |T), f2\ 
that parallel Gaussian interference networks are not separable, 
i.e., parallel interference channels in general need joint coding 
over the carriers to achieve capacity. Thus, for these networks 
the capacity characterization for a fixed channel state does 
not provide a direct extension to the capacity of parallel, e.g., 
time-varying/frequency-selective scenarios. In particular, the 
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Fig. 1 . A MAC-Z-BC network with 5 = 4 transmitters and D = 3 receivers 

ergodic capacity of interference networks can be much higher 
than the average of the capacity expressions for each fixed 
channel state, even with the best power allocation across states 

Gi, a. 

Beyond the special cases identified above, i.e., the Gaussian 
MAC, BC, and interference networks, for the vast major- 
ity of Gaussian networks the separability properties have 
not been determined. As the focus of research in network 
information theory advances through increasingly complex 
network topologies, the separability properties of these net- 
works will be the key to their capacity characterizations in 
the presence of fading. It is this endeavor - the study of 
separability properties of more complex (albeit single-hop) 
Gaussian wireless networks - that is the focus of this paper. 
Our main result can be summarized as follows. The only 
distribute^ single-hop wireless network, which is separable 
from a sum-capacity perspective, is the MAC-Z-BC network 
(Fig. [7] defined formally later). The separability of point-to- 
point MAC and BC networks automatically follow from our 
main result, since they are special cases of the MAC-Z-BC 
network. The separability leads to a characterization of the 
sum-capacity of the parallel MAC-Z-BC network. 

II. System Model : Parallel Single-hop Wireless 
Networks 

Definition 1: Network : A Gaussian wireless single-hop 
network J\f is characterized by {S,D,£,Ai). Here S denotes 
the number of sources or transmitters, D represents the number 
of destinations or receivers. The topology of the network is 

'We assume that nodes are half-duplex, i.e., transmitters cannot receive 
and receivers cannot transmit, so that co-operation, feedback, relaying are all 
precluded in the network. 



identified by a connected undirected bipartite graph between 
the set of transmitters S = {1,2,. ..,5} and the set of 
receivers V = {1,2, . . . , D}, with £ C V x S representing 
the set of edges in the network. C f is used to identify 
the message-graph or message-set, where corresponding to 
element (j, i) 6 Ai, j is termed the message destination, and 
i, the message source. Finally, we assume that 1 < i < 5 
3jo,Oo,j) e M and 1 < j < D ^ 3io,(j,io) £ M. In 
other words, for every source, there exists at least one message 
destination, and similarly, for every destination, there exists at 
least one message source. 

Given a network A/" = {S,D,£,Ji4), an instance of the 
network is uniquely identified by {F, P, H), where F denotes 
the number of carriers, P — {Pi, P2, . . . , Ps) is a S" x 1 
vector denoting the power constraints and H is a DF x SF 
dimensional complex channel gain matrix. The channel gain 
matrix can be expressed as a block matrix, H = [H^ 
where Hj ; is a diagonal F x F dimensional matrix for 
e {l,2,...,D} X {1,2,...,S'}, such that U^,, = 
if (j, i) ^ £■ We use the terms instance of the network, 
and channel, interchangeably in the paper The input-output 
relations of the channel can be represented as 
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where, corresponding to the rth channel use, Xi(r) = 
{Xi{l,T),Xi{2,T), . . . , Xi{F, t)) represents the x 1 com- 
plex input vector at Transmitter i e {1,2, ...,5*}, whose /th 
component indicates the input corresponding to the /th carrier 
for / e {1, 2, . . . , F}. Similarly, for j G {1, 2, . . . , D), Yj (t) 
and Zj(T) are F X 1 vectors respectively representing the 
complex output and circularly symmetric complex additive 
white Gaussian noise respectively. We assume that the additive 
noise has zero-mean and identity covariance. For brevity 
of notation, the dependence on the channel-use index r is 
dropped unless necessary. The /th diagonal entry of diagonal 
matrix Hj ^ represented by Hj,i{f) indicates the channel gain 
between Transmitter i and Receiver j in the /th carrier There 
are \M\ independent messages in the system indicated by 
Wj^i where G A4. Message Wj^i is generated at the 

Transmitter i and is intended for Receiver j. We assume 
that the codewords satisfy an average power constraint, i.e.. 
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Pj, where T denotes the 



length of the codeword. For codewords of length T, the rates 

i°g(|ty,..i) 



are said to be achievable if the probability 



of error of all messages can be made arbitrarily small by 
choosing an appropriately large T. The capacity region of the 
channel {F, P, H) is defined to be the set of all achievable 
rate matrices [Rj,i\ over the channel. The sum-capacity of the 
channel C^(F,P,H) is defined as 
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-Note that the diagonal nature of the channel matrix reflects the fact that 
we assume negligible inter-canier interference. 



Note that the above framework captures any arbitrary parallel 
single-hop wireless network with distributed single-antenna 
half-duplex transmitting and receiving nodes. For example, the 
if -user interference network is characterized hy [S — K,D — 
K,£,M), where £ = {1,2,..., K}^ and M = {{i,i) : i £ 
{l,2,...,_fi'}}. Following standard nomenclature, we refer to 
the edges as the direct links, and the edges 7^ j 

as cross links for i,j G {1,2,..., K}. 

Notation: The notation H{f) is used to indicate the D x 
S matrix of channel gains corresponding to the /th carrier, 
i.e., [Hj4f)], where j = 1,2, D,i =J_, 2,...,S. When 
F = 1, we use H to represent the matrix H{1). We also use 
the notation Xf = (X,(l), Xj(2), . . . , X,(r)) for 1 < i < 
S. The quantities Yj, Zj, xf{f), Y^if), Zj{f) are defined 
similarly for 1 < i < S", 1 < j < D, 1 < / < F. 



A. Separability 

Definition 2: Separability of a Network A channel be- 
longing to network Af characterized by {F, P, H) is said to 
be separable if and only if 
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A channel is said to be inseparable, if it is not separable. A 
network A^ is said to be separable if all its instances (channels) 
are separable. The network is inseparable if it is not separable. 

Remark: We focus on separability from the perspective of 
iMm-capacity of the network in this paper Separability of 
networks from the perspective of the whole capacity region 
can be correspondingly defined; their study is an area of future 
work. 

Definition 3: Sub-network A network J\f — 
{S , D , £ , M- ) is said to be a sub-network of network 

Af = {S,D,£,M) if S' < S,d' < D,£' C £ and 
M' ^A4r\£'. 

In plain words, sub-network Af can be obtained from network 
Af by deleting certain links from network Af. For example, the 
Z-interference network, characterized by {S = 2, D — 2,£ — 
{(1,1),(1,2),(2,2)},A^ = {(1,1), (2, 2)} is a sub-network 
of A'-user interference networks. 

Lemma 1: A network is separable only if all its sub- 
networks are separable. Equivalently, if a sub-network Af 
of network M is inseparable, then the network M is also 
inseparable. 

The above lemma can be shown based on the definition of 
separability as follows. First, note that M can be derived by 
setting certain channel gains in M to zero. Consider the case 
where M is inseparable. The inseparability of M implies 
that an instance of M exists where separate coding is sub- 
optimal. This instance can be used to construct an instance 
of N where separate coding is suboptimal, by setting the 
appropriate channel gain matrices to in M. Hence M is 
inseparable. 



III. Main Result : Unique separability of the 

MAC-Z-BC CHANNEL 

A. Background on Interference Networks and Motivation 

Interference networks have been shown to be inseparable in 
lH], We summarize the main factors behind the insepara- 
bility of interference networks below, since they will be seen 
to recur in our main result as well. 

• O] Joint coding enables interference alignment, whereas 
separate coding does not (used to show inseparability of 
the 3-user interference network). 

• 121 Joint coding enables a receiver to use the interfering 
signal received over certain carriers to cancel interference 
from other carriers - this is not possible with separate 
coding (used to show that the Z-interference network is 
inseparable). 

Note that the interference network does not exploit the full 
potential of the physical channel because every link does 
not carry a message. For example, the capacity of the Z- 
interference channel does not increase (beyond an extent) 
as the strength of the cross-link is made arbitrarily large, 
if the strength of the direct links are held constant. Based 
on this motivation, we study the separability properties of a 
more general class of networks where every link can carry 
a message, i.e., where M can be any sub-set of E. We will 
find that, surprisingly, the Z network - which is physically 
identical to the Z-interference network except that the cross- 
link also carries a message {AA = £) - is in fact separable 
from a sum-capacity perspective. 

B. Main Result : Unique Separability and Sum-Capacity of 
MAC-Z-BC network 

Definition 4: The MAC-Z-BC network is characterized by 
{S,D,£,A4 — £), where £ has the following property. 

deg(T,) > l,i / i ^deg(r.) ^l,\fi,ieS 

deg(i?,) > 1,jV i ^ dcg(i?.) = l,Vj, i' e V 

where, 5 = {1, 2, . . . , S*}, P = {1, 2, . . . , £>}, deg(r,) is the 
degree of Transmitter i, and deg(i?j) is the degree of Receiver 
J- 

Remark: The MAC-Z-BC network, based on the above 
definition, can be noted to contain a MAC component and 
a BC component connected by a Z component (See Fig. [T]!. 
The MAC, BC and Z networks are sub-networks of the MAC- 
Z-BC network. 

The main result of the paper can be stated as follows : 

Theorem 1: A network N is separable if and only if it is 
the MAC-Z-BC network (or one of its sub-networks). 

Theorem 2: Consider a single-carrier MAC-Z-BC channel 
characterized by (1, P, H), where deg(ri) > 1 < deg(i?j) =^ 
j ~ l,i ^ S (See Fig. [T]i. Then, its sum-capacity is 

fl + \HlPs\ 



where H = maxj=i,2,3,...,D \Hj.s\- 

The two theorems lead to a sum-capacity characterization 
of the parallel MAC-Z-BC network as the sum of the sum- 
capacities of the individual carriers, under an optimal power 
allocation. The achievability of the expression in Theorem 
|2] can be seen as follows. Let j* = argmaxj=i_2,...,_D 
so that \H\ — Hj*,s- Transmitter 5' generates only one 
message Wj',s and sets all other messages to null, i.e., 
Wj.s = <t>ii 7^ j* ■ If i* ~ 1> then the capacity can be 
achieved over the multiple access channel formed at Re- 
ceiver 1 and Transmitters 1,2, ...,S'. If j* ^ 1, Receiver 
j* observes a point-to-point channel from Transmitter S to 
achieve a rate of log(l + \Hj*,s\'^Ps)- Receiver 1 treats the 
interference from Transmitter S as noise and a total rate of 
log(l + \Hi^i\'^Pi) can be achieved for the messages 

Wij,j ^ S over the multiple access channel formed at 
the receiver. The converse for Theorem |2] follows from the 
converse of Theorem [Tl (Appendix lAli. 

The proof of Theorem [T] involves two parts. First, we prove 
that the MAC-Z-BC network is separable; then, we show 
that any network which is not the MAC-Z-BC network is 
inseparable. The proof of the separability of the MAC-Z-BC 
network is placed in Appendix lAl Intuitively, the separability 
of the Z network (which is a sub-network of the MAC-Z- 
BC network) can be understood as follows. Note that the 
Z-interference network is inseparable because joint coding 
enables better interference-cancellation over the cross-link. 
However, in the Z network, any bit that the receiver is able to 
decode over the cross-link can be used for the desired message, 
rather than for interference management and the second factor 
of inseparability listed in Section IIII-AI is avoided from a 
sum-capacity perspective. We will now present a proof of the 
second part of Theorem [T] i.e., we show that any network 
which is not the MAC-Z-BC network is inseparable. 

Property 1: Consider any network M characterized by 
(5, D,£,M = £). In the network, if 3{i, ^ j such that 

deg(r,) > 1 < deg(rj) or deg(i?,) > 1 < deg(i?j) 

then, the network JV has at least one of the following three 
networks as a sub-network. 

1) The Z-interference network. 

2) The 2-user X network (Fig. ^a)), with S = 2,D = 
2,5== {1,2} X {1,2}, M=£. 

3) The E network (Fig. I^b)), with S = 2,D = 3,£ = 
{(l,l),(2,l),(2,2),(3,2)},X=f. 

4) The 3 network (Fig. Ec)), with S ^ 3,D = 2,£ = 
{(1,1),(1,2),(2,2),(2,3)},X=£. 

Based on the above property of connected bipartite graphs 
(See Appendex |B] for a proof) and Lemma [H it is enough to 
show that the Z-interference network, 2-user X network, the 
E network and the S networks are all inseparable. The Z- 
interference network has been shown to be inseparable in 12| . 
We show the inseparability of the latter networks below. 

1) The 2-user X network: Consider a 2-user X channel 
(See Fig. El (a)) where F = 3,P={P, P) and 
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(a) A 2-user X channel with F = 3 carriers 
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(b) A E channel with F = 2 carriers 



(c) A 2 channel with F = 2 carriers 
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Fig. 2. Inseparable wireless channels (Note that the number on the link denotes the channel gain). 

interference-free dimension can be achieved for each of the 

^ fill desired messages at a receiver. Each message can thus 

{H{2)) , H{3) ^ ^ achieve a rate of log(P) + o(log(F)) |51 and 

C^(1,P,H) > 41og(P) + o(log(P)). 



With this, it can be noted (because of the fact that the first two 
carriers form Z channels, and the third carrier is a degraded 
X channel [4|) that 

C^(l,P,ff(/)) <log(P)+o(log(P)) 



max / 
<31og(P)+o(log(P)), 



^C^(l,p'^',i7(/)) 



(2) 



Joint coding can achieve a higher rate (scaling with P). To 
see this consider an achievable scheme, where each mes- 
sage Wi,j,i,j g is encoded as a Gaussian codeword 
Xij{T),T = 1,2, . . . ,T. The transmit codeword at Transmitter 
j, Xj , is determined as 

D 

:^:{r)=J2x,4T)Y,,, (3) 
i=i 

where r = 1, 2, . . . , T, and Yj,i is a P x 1 (beamforming) 
vector as follows. 

Vi,i=Vi,2 = [l 1],V2,2 = V2,l = [0 1 1] 

The above beamforming vectors ensure that Hi 1V2.1 ~ 
H1.2V2.2 and H2,iVi 1 = H2.2V1.2, i.e., both interfering 
messages at each receiver are aligned into one dimension, sim- 
ilar to |5|. It can also be verified that, at Receiver j g {1, 2}, 
the two desired signal vectors are linearly independent of the 
(aligned) interference. Thus in a P = 3 dimensional space, 
by linearly nulling the (aligned) interference dimension, one 



Comparing the above with (|2]), we can conclude that, for 
sufficiently large P, the 2-user X channel is inseparable. Thus, 
the enabling of alignment via joint coding renders the 2-user 
X network inseparable. 

2) The S network: The inseparability of the S channel 
where P — 2, P — {P,P) and the channel gains shown 
in Figure |2] (b) can be shown based on the enabling of 
interference alignment. To see this, first, note that separate 
coding allows, at most, a sum-rate of 21og(P) + o(log(P)), 
since each carrier viewed separately forms a Z channel whose 
sum-rate is at most log(P) + o(log(P)) per carrier |6|. A 
sum-rate of 31og(P) + o(log(P)) based on a joint coding 
scheme, with each of Wi^i,W2.i,W^_2 achieving a rate of 
log(P) + o(log(P)) (and Pi^2 — 0)). The messages are 
encoded as in where Vi 1 = V2,3 = [1 0]-'" and V2,i = 
[1 1]"^. Then, the two interfering messages Wi^i,Wz,2 align 
at Receiver 2, i.e. H2.1V1 1 — H2,2V3 2- It can be verified 
that this scheme achieves one interference-free dimension for 
1^1.1, W^2,i, M^3,2 SO that the desired rate (scaling with P) is 
achieved implying the inseparability of the E network. 

3} The 3 network: The S channel of Fig. Iljc), which is 
a reciprocal of the S channel of Fig. |2] (b) can be shown 
to be inseparable using the reciprocity of beamforming based 
alignment schemes (Q, |0]). Note that in the 3 network, each 
receiver faces at most one interferer, and it is hard to conceive 
of the possibility of alignment. We take a closer look at the 
channel to understand its inseparability from the perspective 
of the factors listed in Section IIII-AI First note that separate 



coding achieves a sum-rate of at most 21og(P) + o(log(P)), 
since each carrier forms a Z channel. A sum-rate of 3 log(P) + 
o(log(P)) can be achieved using joint coding with each of 
1^1.1, W^i,2, W^2,3 achieving 1 interference-free dimension. To 
see this, let Transmitter 2 encode W\_2 so that it transmits iden- 
tical signals on both carriers - this would be a beamforming 
based joint coding scheme where the beamforming vector is 
[1 1]^. Then, each of the two receivers can subtract the signals 
received along both carriers to null the signal from Transmitter 
2 to achieve an interference-free dimension for Wi_i,VF2,3- 
Note that Receiver 1 gets an interference-free dimension for 
W\ 2 on the first carrier Thus, joint coding enables better 
interference cancellation at the two receivers and the second 
factor identified in Section IIII-AI causes inseparability. While 
the fundamental reason of inseparability remains the same 
as the Z-interference channel ID, the nature of interference- 
cancellation in our example differs from the fT\ in that it is 
linear, whereas the scheme in [2] is non-linear (successive 
decoding). Note that unlike the Z network where interference 
management (and the associated factor of inseparability) can 
be avoided by using the cross-link for the desired message, 
interference management is unavoidable in the 3 network 
because Wi_2 and Wi.\ are necessarily an interfering messages 
respectively for Receivers 2 and 1. 

IV. Conclusion 

We recognize two principle factors causing inseparability 
in parallel wireless networks and based on the intuition 
obtained, identify the MAC-Z-BC as the uniquely separable 
wireless network. Associated interesting areas of future work 
are identification of separability properties of networks with 
multiple antennas, and its study from the perspective of the 
entire capacity region. 

Appendix A 
The MAC-Z-BC channel is separable 

We assume that deg(Ti) > 1 < dcg(P.,) ^ j = l,i = D 
(See Fig. [T]!. We show a (tight) converse, which bounds the 
sum-rate on the parallel MAC-Z-BC channel. The achievabil- 
ity of the sum-rate upper bound follows from separate coding 
and the capacity of the single-carrier MAC-Z-BC (Theorem 
|2|. For the converse, we create Receiver D + 1 whose output 
is 

Yz,+ i(t) =HX5(T)+Zi5+l(T) 

where Z^i+i is unit-variance circularly symmetric white Gaus- 
sian noise. H is a P x P diagonal matrix whose /th diagonal 

entry is determined as = max^^i D-ffi.s(/)- Note 

that Receiver P* + 1 is an enhanced receiver so that, with 
any achievable scheme, it can decode Wi Vi = 1, 2, . . . , P. 
Given any achievable scheme of length T, we denote Pj = 

E , J = 1, 2, . . . , 5. Note that E/=i < Pj- 

Using Fano's inequality for we can write for any e > 



= MHX^ + zS+i)-MzS+i) (4) 



R 



Te < /(Y 



S-1 



J2Ri,j~Te < /(Yf;Xf,Xr,...,X^„i) 

= MYf ) - /j(Hi,sX^ + Zf ) (5) 

Adding dU,©, we get 
+ hiHX^s + Z^+i) - /i(Hi,5Xf + Z[) 

F 

<TY,[h{Y*{f))-hiZh+,{f)) 
/=i 

+ h{H{f)X*s{f) + Z},+^{f)) - h{H^,sX*s{f) + Zlif)) 

where, in the final inequality, the asterisk superscript indicates 
that the entropy is evaluated using a Gaussian distribution 
where the variance of Xi{f) is P\^\ In the inequality, the first 
term follows from the the chain rule, the facts that conditioning 
reduces entropy, and that the circularly symmetric Gaussian 
random variables maximize differential entropy under a power 
constraint. The second term follows simply from the distribu- 
tion of the additive noise. The final two terms are bounded 
using the fact that Hi,s(f)Xs{fY + is a degraded 

version of H{f)Xs{fV + Zo+iifV for all / = 1, 2, . . . , P 
and Lemma 2 in HS). Thus, we can write 



C 



MAC-Z-BC / -n TT 



(p,p,H) < E ( i°g I i+Ei^i-^-(/)i'^'^' 



/=1 



2p[/l 



log 



l + \H{f)\'P, 
l + \H,M?Pk' 



[/] 



This completes the proof. 



Appendix B 
Proof of Property 1 

Consider any network Af characterized by S,D,£,A4. We 
split the proof into various cases. 

Case 1 : Mj^S 

In this case, £ — A4is non-empty; without loss of generality, 
let (1,1) G £ — M. Also, based on the system model 
3io,jo such that (l,io) G M and (jo, 1) £ M. Now, the 
edges {(1, 1), (1, io), (jo, 1)} form a Z-interference network. 
Therefore, the Z-interference network is a sub-network of Af 
if M^£. 

Case 2 : M = £, and 3zo ^ jo,deg{Ti„) > 1 < deg(TjJ 

Let Vi = { j : E £,j G {1,2,..., D} represent the set 
of destinations which are connected directly to source node i. 
Note that |2?io| > 1 < |2?jol- We divide this case into three 
sub-cases as follows. 



1) Sub-case (a) : \T>ig fl 'Djgl > 2: In this case, let ii 
«2,«i,«2 G 2?io nPjo. Then, the edges {ii,ji} x {io,jo} C 
£ = M form a 2-user X network as a sub-network of AT. 

2j Sub-case (b) - \Vig n Pj^l = 1; Here, let ki G 
Dig n Vjg. Also, let ii ^ fci ^ ji and ii € 
^io'Ji G I'jo. Then, it can be easily noted that the edges 
{(ii,io), (A:i,io), {hjo), O'l, jo)} C £ form a S network as 
a sub-network of A/^. 

5J Sub-case (d) - Dig n Vj^ = </>; Let ii e 2?i(, and 
ji € "Djg. Note that we consider connected network graphs 
in our model. Let Ei, E2, ■ ■ ■ ,Ej^ be a sequence of edges 
denoting a path, devoid of cycles, between nodes ii and 
ji, where En £ A/", n = 1,2, ...,A^. First, note that since 
the path is between two receivers (in our bipartite network 
graph), N has to be even. Now, note that if A?" > 3, this 
automatically means that the edges Ei,E2, i?3, £'4 form a E 
network. Therefore, we only need to consider the case where 
N = 2. If N = 2, let El = (ii,fco) and E2 = iji,ko). 
Notice that we are considering the case where Vig D Vjg = 
(j) which means that io ko ^ jo- Then, the edges 
{{ii,io), {■ii,ko), {ji,ko), (ji, jo)} C £ form a S. network as 
a sub-network of M. 

Case 3 : M = £, and 3io ^ jo,deg{Rio) > 1 < deg{Rjg) 

The proof for this case is similar to the proof for case 2. 
This completes the proof. 
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